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ABSTRACT 

There  has  recently  been  considerable  interest  in  applying 
Total  Variation  regularization  with  an  i1  data  fidelity  term 
to  the  denoising  of  images  subject  to  salt  and  pepper  noise, 
but  the  extension  of  this  formulation  to  more  general  prob¬ 
lems,  such  as  deconvolution,  has  received  little  attention. 
We  consider  this  problem,  comparing  the  performance  of  l1- 
TV  deconvolution,  computed  via  our  Iteratively  Reweighted 
Norm  algorithm,  with  an  alternative  variational  approach 
based  on  Mumford-Shah  regularization.  The  ^-TV  decon¬ 
volution  method  is  found  to  have  a  significant  advantage  in 
reconstruction  quality,  with  comparable  computational  cost. 

Index  Terms —  Image  restoration,  Deconvolution,  Im¬ 
pulse  noise,  Total  Variation 


has  attracted  attention  due  to  a  number  of  advantages  [6],  in¬ 
cluding  superior  performance  with  non-Gaussian  noise  such 
as  salt  and  pepper  noise.  While  rapid  progress  has  been  made 
on  the  development  of  efficient  algorithms  for  minimizing 
this  functional  [7,  8,  9],  the  majority  of  these  methods  are 
restricted  to  the  denoising  problem,  corresponding  to  setting 
K  to  the  identity  operator,  and,  presumably  for  this  reason, 
application  of  the  P-TY  functional  for  more  general  inverse 
problems,  such  as  deconvolution,  has  received  little  attention 
in  the  literature.  In  this  paper  we  provide  new  experimental 
results  for  our  Iteratively  Reweighted  Norm  (IRN)  algorithm 
[10,  11]  applied  to  the  problem  of  deconvolution  subject  to 
salt  and  pepper  noise,  and  compare  performance  on  this  prob¬ 
lem  with  that  of  a  prominent  recent  approach  [12]  based  on  a 
different  variational  principle. 


1.  INTRODUCTION 


The  standard  Total  Variation  (TV)  regularization  functional 
[1],  which  we  shall  refer  to  as  £2-TY,  may  be  written  as 


T(“>  =  5 


K  u  —  s 


+  A 


^(AcU)2  +  (Dy  U)2 


where  s  is  the  data,  K  is  the  linear  operator  representing  the 
forward  problem,  and  we  employ  the  following  notation: 


•  the  p-norm  of  vector  u  is  denoted  by  ||u||p, 

•  scalar  operations  applied  to  a  vector  are  considered  to 
be  applied  element-wise,  so  that,  for  example,  u  = 

v2  =>  Uk  =  v\  and  u  =  -y/v  =>  Uk  =  y'u/c,  and 

•  horizontal  and  vertical  discrete  derivative  operators  are 
denoted  by  Dx  and  Dy  respectively. 


2.  ITERATIVELY  REWEIGHTED  NORM 
APPROACH 


The  IRN  algorithm  [10,  11]  for  minimizing  the  generalized 
TV  functional 
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is  motivated  by  the  Iteratively  Reweighted  Least  Squares 
(IRLS)  method  [13,  14,  15]  for  solving  the  minimum  £p  norm 
problem  minu  ^\\Ku  —  s||£  by  solving  a  sequence  of  mini¬ 
mum  weighted  £2  norm  problems.  These  methods  represent 
the  £p  norm  of  u 
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This  functional  has  been  applied  to  a  wide  variety  of  image 
restoration  problems,  including  denoising  [1]  and  deconvolu¬ 
tion  [2,  3]  of  images  subject  to  Gaussian  white  noise. 

More  recently,  the  P-TY  functional  [4,  5] 


by  the  weighted  l2  norm  of  u 
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with  diagonal  weight  matrix  W  =  (2 /p)  diag  (|u|p-2)  .  At 
each  iteration  of  an  iterative  scheme,  the  £p  norm  is  approx¬ 
imated  by  the  weighted  £2  norm  using  the  weights  from  the 
previous  iteration. 
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The  weighted  £2  equivalent  of  (1)  may  be  written  (the 
reader  is  referred  to  [10,  1 1]  for  full  details  of  the  derivation) 
as 


T(u)  =  i|wT2  (Ku  -  s) 
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and  functions  (with  corresponding  threshold  parameters  ep 
and  eR) 


and 


if  |a;|  >  ep 
if  | a; j  <  eF, 


if  \x\  >  eR 
if  jxj  <  eR, 


are  required  to  avoid  the  possibility  of  infinite  weights  when 
p  <  2  and  q  <  2  respectively.  The  minimum  of  this  func¬ 
tional  is 


u  =  ( KtWfK  +  A  DTWRD)  1  KtWf  s,  (2) 


and  the  resulting  algorithm  consists  of  the  following  steps: 


Initialize 

u0  =  ( KtK  +  A  DtD)~1  Kt  s 


Iterate 

WFik  =  diag  ^fF(Kuk-i  -  s)^ 

WR>k  =  diag  ((Dx ufc_i)2  +  (Dyufe_i)2)^ 

ufc  =  (. KTWF,kK  +  \DlWR,kDx 
+XD^WR,kDy)~1  KTWF,ks 


The  matrix  inversion  is  achieved  using  the  Conjugate  Gradi¬ 
ent  (CG)  method. 


3.  RESULTS 

We  compare  the  performance  of  ^1-TV  deconvolution,  com¬ 
puted  via  the  IRN  algorithm,  with  that  of  an  alternative  vari¬ 
ational  approach  [12]  (which  we  shall  refer  to  as  the  BKS 
method)  combining  an  approximate  i1  data  fidelity  term  with 
the  Mumford-Shah  regularization  term  [16].  The  BKS  results 


are  computed  using  the  Matlab  code  written  by  the  authors 
of  [12],  and  the  i^-TV  results  are  computed  using  the  purely 
Matlab  implementation  (for  a  fair  comparison  of  computation 
times)  of  the  IRN  algorithm  from  the  NUMIPAD  library  [17]. 
The  first  test  uses  the  236  x  236  pixel  Einstein  image  (see  Fig. 
1),  convolved  with  a  3  x  3  pillbox  kernel  and  subjected  to  salt 
and  pepper  noise.  This  example  is  identical  to  one  of  those 
set  up  by  Bar  et  al.  [12],  allowing  us  to  make  a  fair  compar¬ 
ison  by  using  their  parameter  choices  for  their  method.  The 
second  test  uses  the  512  x  512  pixel  Boat  image  (see  Fig.  2), 
convolved  with  a  7  x  7  Gaussian  kernel  of  standard  deviation 
2.0,  and  subjected  to  salt  and  pepper  noise.  In  this  case  we 
made  our  own  best  effort  to  select  optimal  parameters  for  the 
BKS  algorithm. 


Fig.  1.  Einstein  test  image  (236  x  236  pixel). 


Fig.  2.  Boat  test  image  (512  x  512  pixel). 

Reconstruction  SNR  values  and  computation  times  are 
compared  in  Table  1,  and  noisy  and  reconstructed  images  are 
displayed  in  Figs.  3  to  5.  The  ^1-TV  results  are  significantly 
better  for  both  noise  levels  of  the  Einstein  image,  exhibiting 
both  less  residual  noise  and  less  blur.  In  the  30%  noise  case 
in  particular,  the  visual  quality  of  the  ^-TV  result  is  remark¬ 
able,  considering  the  level  of  degradation  to  the  test  image.  A 
similar  comparison  holds  for  the  Boat  image  (note  the  SNR 
values),  but  the  visual  difference,  while  obvious  when  viewed 
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at  full  size  on  a  display  unit,  is  much  less  apparent  in  the 
small  printed  version  in  Fig.  5(b).  Computation  times  for 
both  methods  are  very  similar. 


SNR  (db) 

Time  (s) 

Image 

Noise 

BKS 

r-Tv 

BKS 

P--TV 

Einstein 

10% 

7.9 

20.5 

58 

55 

30% 

2.2 

15.8 

57 

50 

Boat 

10% 

9.3 

20.1 

282 

356 

30% 

9.7 

16.5 

282 

289 

Table  1.  Deconvolution  performance  comparison  between 
BKS  [12]  method  and  £1-TV,  computed  via  the  IRN  algo¬ 
rithm,  on  the  Einstein  and  Boat  test  images. 


4.  CONCLUSIONS 

The  recent  IRN  algorithm  is  a  computationally  efficient  ap¬ 
proach  to  minimizing  the  £1-TV  functional  for  general  in¬ 
verse  problems,  which  are  not  addressed  by  most  alternative 
^-TV  algorithms,  which  concentrate  on  the  denoising  prob¬ 
lem.  Computations  times  for  the  problem  of  deconvolution  of 
images  with  salt  and  pepper  noise  are  similar  to  those  of  the 
BKS  algorithm,  but  the  ^-TV  functional  appears  to  provide 
significantly  better  results  than  the  ^-Mumford-Shah  func¬ 
tional  minimized  by  the  BKS  algorithm. 
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(a)  Blur  and  10%  salt  and  pepper  noise 


(b)  BKS  reconstruction  (c)  l1  -TV  IRN  reconstruction 


Fig.  3.  Deconvolution  with  10%  salt  and  pepper  noise. 


(a)  Blur  and  30%  salt  and  pepper  noise 


(b)  BKS  reconstruction 


(c)  i1  -TV  IRN  reconstruction 


Fig.  4.  Deconvolution  with  30%  salt  and  pepper  noise. 


(a)  Blur  and  30%  salt  and  pepper  noise 


(b)  BKS  reconstruction 


(c)  i1  -TV  IRN  reconstruction 


Fig.  5.  Deconvolution  with  30%  salt  and  pepper  noise. 


1260 


